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Abstract. The product of any finite number of factorial Schur functions can 
be expanded as a Z[y]-linear combination of Schur functions. We give a rule 
for computing the coefficients in such an expansion which generalizes a spe- 
cialization of the Molev-Sagan rule, which in turn generalizes the classical 
Littlewood-Richardson rule. 
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I. Introduction 

Let Vn denote the set of partitions {A ~ (Ai, . . . , A„) G N" | Ai > ■ • ■ > A„}, and 
for X £ Pn, let 7a denote the set of all Young tableaux of shape A with entries in 
{!,..., n}. Let x = (xi, . . . , Xn) and y — {yi, y2, . . .) be two sets of variables. The 
Schur function s\(x) and factorial Schur function s\{x \ y) are defined as follows: 

Sx{x) ^ X! n ^^'^ ■SA(a;|y)= X! ^{^o.+ya+c(a)-r(a)) , 

where for entry a £ T, c(a) and r(a) are the column and row numbers of a respec- 
tively. Note that if y is specialized to (0,0, . . .), then s\{x \ y) = s\{x). Factorial 
Schur functions are special cases of Lascoux and Schiitzenberger's double Schubert 
polynomials |LS1[ ILS2] . Various versions of factorial Schur functions and their 
properties have been studied by [BL], [CL], [GG] . [Lai], [MaS], [Mai], [MoT] , and 
[Mo2| (see |Mi| and |MS| for more discussion of these functions). 

Let r G N. For i G {l,...,r}, let y^*-' — (yj'-*, j/j'^ • ■ •) be an infinite set of 
variables, and let y denote the set of variables (y*^^-* , . . . , y^''^). As A varies over 
■p„, both the Schur functions s\{x) and the factorial Schur functions s\{x\y'^^'^) 
(where i G {l,...,r} is fixed) form Z[y]-bases for Z[x,y]'^", the ring of polyno- 
mials in the x and y variables which are symmetric in the x variables. Hence 
for any sequence A = (A'-^-', . . . , A^'"') of elements of Vn, the polynomial sx{x \ y) = 
■Sa(i) (^ I y^^'') ' ■ ' ■SaC'-) I y'''^') can be expanded as a Z[y]-linear combination of Schur 
functions: 

(1) sx{x\y) = ^ c''^{y)s^,{x), for some c^(y) G Z[y]. 
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We give a rule for computing the coefficients (y) for arbitrary A. Our rule gener- 
alizes a rule by Molev-Sagan [MS| Theorem 3.1], which computes c^(y) for r — 2, 
y^^^ = (0, 0, . . .). The Molev-Sagan rule in turn generalizes the classical Littlewood- 
Richardson rule |LR| . which computes c^(y) for r = 2, y*^^-* = y^^-* = (0,0,...). 
When r = 1, the coefficients c^(y) give the change of Z[y]-basis coefficients be- 
tween the Schur and factorial Schur functions. Another rule for these change of 
basis coefficients which, like ours, is tableau-based, is given by Molev |Mol| . and 
a determinantal formula is given by Macdonald |Ma2| . More generally, change of 
basis coefficients between Schubert and double Schubert polynomials were obtained 
by Macdonald [Mal| and Lascoux [La2j . 

A related problem is to expand sx{x \ y) in the basis of factorial Schur functions 
{Sfiix I y^^^),iJ, € Vn}- A solution to this problem for r = 2 was given by Molev- 
Sagan |MS[ Theorem 3.1] (the Molev-Sagan rule discussed above is obtained from 
this one by specializing y'-^^ — (0,0,...)), and a solution for r — 2, y'^^^ — 
which is positive in the sense of Graham |Grj was given by Knutson-Tao [KT] . 
Molev |Mol| . and Kreiman [Krj . 

The proof of our rule for (y) generalizes a concise proof by Stembridge of 
the classical Littlewood-Richardson rule. Stembridge's proof relies on sign-reversing 
involutions on skew tableaux which were introduced by Bender and Knuth [BKj . 
We generalize these arguments and constructions to barred skew tableaux, which 
are refinements of skew tableaux. Our proof is similar to but simpler than the proof 
used in 'Kr] , where Stembridge's methods are generalized to hatted skew tableaux. 

Acknowledgements. We thank W. Graham and A. Molev for helpful com- 
ments and suggestions. 



2. Computing the Coefficients c^(y) 

As above, let A = (A^^), . . . , A''^)) be a sequence of elements in P„, or, alterna- 
tively, of Young diagrams. Denote also by A the skew diagram formed by placing 
each Young diagram in the sequence A*^^) , . . . , A'-'"' below and to the left of the pre- 
ceding one. A barred skew tableau T of shape A is a filling of the boxes of 
the skew diagram A with elements of {1, . . . , n} U {1, . . . , n} in such a way that the 
entries weakly increase along any row from left to right and strictly increase along 
any column from top to bottom, without regard to whether or not the entries are 
barred. 

The unbarred column word of T is the sequence of unbarred entries of T 
obtained by beginning at the top of the rightmost column, reading down, then 
moving to the top of the next to rightmost column and reading down, etc. (the 
barred entries are just skipped over in this process). We say that the unbarred 
column word of T is Yamanouchi if, when one writes down its entries and stops 
at any point, one will have written at least as many ones as twos, at least as many 
twos as threes, etc. The unbarred content of T is ll!{T) = (■Cij • ■ • ; ^n) G N", 
where is the number of unbarred fc's in T . Define CT(y) = Jl where 
the product is over all barred a € i{a) is the index of the particular Young 
diagram in which a resides, and c(a) and r(a) denote the column and row numbers 
of a in this Young diagram. 
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Figure 1. A barred skew tableaux T of shape A and un- 
barred content ^, where A = ((4, 2, 2), (2, 1), (5, 4, 2, 1)), and 
/i — i-u{T) — (6,3,3,3,1). The unbarred column word 
of T is 1123123421141345, which is Yamanouchi. Thus 
T e CTZ"^. We have criy) 



n{i{a)) 
aGT,a barred 



i-\-c(a) — r{a) 

(1) (2) (2) (3) (3) (3) (3) _ (1) (2) (2) 

^1+3-1 ^3+1-1 2^4+2-1 2/1+1-1 2/3+2-2 2^5+4-2 2/5+2-3 ~ 2/3 Vs Vb 
(3) (3) (3) (3) 

Vi 2/3 2/7 2/4 • 



Definition 2.1. Denote the set of all barred skew tableaux of shape A by B\, and 
the set of all barred skew tableaux of B\ of unbarred content fi whose unbarred 
column words are Yamanouchi by CRf^ . 

Theorem 2.2. c^(y) = ^^iy) = E ( 11 ylS(i)-.(a) 

^ a barred 

Example 2.3. Letn^2, X = ((2, 1), (1, 1)), and fi ^ (2,2). We list allT e CTZ'^, 
and for each T we give CT{y): 
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CT(y) = y^i^ criy) = y^^^ criy) ^ yi^^ criy) = y^i' 



By Theorem\ER c^(y) y^i ^ + 2/2^^ + yf^ + Vi^- 

Remark 2.4. If y^^^ is specialized to (0,0,...) for some i, then s-x(i)(x\y^^^) — 
Sx{i){x). In this case, if T £ CRJ^ has a barred entry in Young diagram A^*-*, then 
CT(y) — 0. Thus in Theorem c^(y) is computed by summing over only those 
T G CTZ'^ with no barred entries in Young diagram A^'^ . 

Remark 2.5. For simplicity, we assume here that y := y^^"^ = ■ ■ ■ — y''^\ and we 
denote y by just y. Theorem \ 2.S\ has the following representation-theoretic inter- 
pretation. Let G = GLniC), and let H = C* x <C* x ■ ■ ■ . For A S Vn, let V\ denote 
the irreducible G representation of highest weight A. For m G Z[2/] = Z[?/i, ?/2, ■ ■ ] a 



4 



VICTOR KREIMAN 



monomial with coefficient I, let Lm denote the H representation with character m. 
For A G Vn, define the following G x H representation: 

By Theorem\2^ GhaiGxHU\ = I]^g-p^. Tecj-^^ s^,{x)cT{y) = Sf_,{x\y). 

Let R{GxH) denote the polynomial representation ring ofGxH (i.e., the subring 
of the full representation ring ofGxH generated by the polynomial representations) 
and R{H) the polynomial representation ring of H. Then R{G x H) = Z[x]^" (8> 
Z[y] = Z[x, 2/]'^", and R{H) = Since {s\{x \y) | A G Pn} forms a Z[y]-basis for 

Z[x,y]''^", the classes{[Ux] | A G P„} C R{GxH) form an R{H) -basis for R{GxH). 
Theorem \2.2\ imvlies the following decomposition as G x H representations: 

Ux(l)(g>---(g)Ux(t} ^ Vf^^L^^^yy 

Remark 2.6. Factorial Schur functions can be defined in terms of reverse Young 
tableaux instead of Young tableaux (see [Krjj. Beginning with this definition, and 
with several minor adjustments to the proofs, one can obtain a rule for c^(y) which 
is almost the same as that of Theorem except that it is expressed in terms 
of reverse barred skew tableaux instead of barred skew tableaux, with appropriate 
adjustments to the indexing of columns and rows. This rule is similar in form to 
the factorial Littlewood- Richardson rule of Molev [Molj and Kreiman [Krj . which 
is equivalent to the Knutson-Tao rule [KTj . 

3. Generalization of Stembridge's Proof 

In this section we prove Theorem 12.21 The underlying structure and logic of our 
proof follows Stembridge [St]. Our approach is to generalize Stembridge's methods 
from skew tableaux to barred skew tableaux. 

For ^ = (^1, . . . ,^„) G W\ define a^(a;) = det[(a;i)?j]i<jj<„. Let p = (n - l,n - 
2,...,0)gP„. 

Lemma 3.1. ap{x)sx{x \ y) = EtgBa CT(y)ap+c^(T) (a^)- 

Lemma 3.2. X) '^r(y)ap+w(T) (2;) ~ 0, where the sum is over all T G Bx such that 
the unbarred column word ofT is not Yamanouchi. 

The proofs of these two lemmas appear at the end of this section. The following 
three corollaries are easy consequences. 

Corollary 3.3. ap{x)sx{x \ y) — J2 '^T{y)0'p+uj{T){x), where the sum is over all 
T G Bx such that the unbarred column word of T is Yamanouchi. 

If we set r = 1, A = (A), and y = ((0, 0, . . .)) in Corollarv l3.31 then sx{x \ y) = sx{x), 
and there is a unique T ^ Bx with no barred entries (so that criy) 7^ 0; see Remark 
12. 4p whose unbarred column word is Yamanouchi: namely, the tableau whose i-th 
row contains all i's. For this T, cxiy) = 1 and w(T') = A. Thus we obtain the well 
known bialternant formula for the Schur function. 

Corollary 3.4. sx{x) = ap+x{x)/ap{x). 

Dividing both sides of CoroUarv 13.31 bv ap{x) and applying CoroUarv 13.41 vields 
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Corollary 3.5. sx{x\y) = J2 '^Tiy)su(T)ix), where the sum is over all T ^ Bx 
such that the unbarred column word of T is Yamanouchi. 

Regrouping terms in the summation, sxix \ y) — J^fiev^ J^tgctz^' ^Tiy)s^{x). This 
proves Theorem 12.21 

Involutions on Barred Skew Tableaux. The proofs of Lemmas 13.11 and 13.21 

rely on involutions si, . . . , s„_i on Bx, which generalize the involutions on Young 
tableaux introduced by Bender and Knuth ^BKj. We now define these involutions 
and prove several of their properties. 

Let T ^ Bx, and let i G {1, . . . , n — 1} be fixed. Let a be an entry of T. Then 
either a = j or a = j, where j G {1, . . . , n}. We call j the value of a. We say 
that an entry of T of value i or i + 1 is free if there is no entry of value i + 1 or i 
respectively in the same column; semi-free if there is an entry of value i + 1 or i 
respectively in the same column, and exactly one of the two is barred; or locked 
if there is an entry of value z + 1 or i respectively in the same column, and either 
both entries are unbarred or both entries are barred. Note that any entry of value 
i or J + 1 must be exactly one of these three types. In any row, the free entries 
are consecutive. Semi-free entries come in pairs, one below the other, as do locked 
entries. 

The barred skew tableau s^T is obtained by applying Alorithm 1 to each semi- 
free pair of entries in T, and applying Algorithm 2 to each maximal string of 
consecutive free entries S lying on the same row. 

Algorithm 1 

For a semi-free pair consisting of two entries lying in the same 
column of T , the bar is removed from the barred entry and placed 
on top of the unbarred entry. 

Algorithm 2 

Let I be the number of (unbarred) i 's and r the number of (unbarred) 
i + I's that S contains. 

• If I = r: Do not change S. 

• If I < r: If I = Q then define R = S. Otherwise, letting Si 
be the l-th i of S from the left and S2 the l-th i + 1 of S from 
the right, define R to be the string of consecutive entries of S 
beginning with the first i + l ori + 1 of S to the right of Si and 
ending with the first i + l of S to the left of S2 . Note that each 
entry of R is either an i + 1 or i + 1. Modify R as follows: 

1. change each i + l to an i and each i + l to an i; and 
then 

2. beginning with the rightmost i and then proceeding to the 
left, swap each i with the i immediately to the right of 
it. 

• Ifl>r: If r = then define R — S. Otherwise, letting Si be 
the r-th i of S from the left and S2 the r-th i + l of S from 
the right, define R to be the string of consecutive entries of S 
beginning with the first i of S to the right of Si and ending 
with the first i or i of S to the left of S2 ■ Note that each entry 
of R is either an i or an i. Modify R as follows: 



6 



VICTOR KREIMAN 



1. change each i to an i + 1 and each i to an i + 1; and 
then 

2. beginning with the leftmost i + 1 and then proceeding to 
the right, swap each i + 1 with the z + 1 immediately to 
the left of it. 



One checks that is an involution on B\. Let S'„ denote the permutation group 
on n elements and ct.; the simple transposition of S'„ which exchanges i and i + 1. 
The following Lemma follows from the construction of s^. 

Lemma 3.6. Let T e Bx- Then 
(■i) CsiTiy) = CT(y). 
(a) Lj{siT) = aiUj{T). 

Let T E B\ and let G S'„. Choose some decomposition of a into simple 
transpositions: a (7^^ • • • (7^^ , and define aT = Si-^ ■ ■ ■ Si^T . By Lemma 13.61 

(2) CcrT(y) = CT(y) and uj{aT) = auj{T). 

In particular, although aT depends on the decomposition of a, both Ca-riy) and 
uj{aT) are independent of the decomposition. 

Proof of Lemmas [O and [3721 

Proof of Lemma \3.1i Expanding sx{x \ y) into monomials: 



SA(.T|y)=nsA(.)(^l2/^*^) 



n X! n (^'^ + yi+c(a)-r{a) 
n X! n ^'^ n yi+c(a)-r(a) 

C^^ '} o unbarred a barred 



Therefore 



apix)sx{x\y)= J] J] sgn(a):r-(^)x-(^)cT(y) 

= ^ ^ sgn(a)a;-(^):r'^('^^)c.T(y) 
o-es„ tsKa 

= E E CT(y)sgn(a)2;-(^+-(^» = ^ CT(y)ap+^(T) (x). 

The second equality follows from the fact that a is an involution on Bx; thus as T 
varies over Bx, so does aT. The third equality follows from □ 

Proof of Lemma W^ For T & Bx and j a positive integer, define T<j to be the 
barred skew tableau consisting of the columns of T lying to the left of column j 
(and similarly for T<j, r>j, T>j). 
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We will call the T e Bx for which uj{T>j) ^ Vn for some j Bad Guys (i.e., T 
is a Bad Guy if and only if its unbarred column word is not Yamanouchi). Let T 
be a Bad Guy, and let j be maximal such that uj{T>j) ^ Vn- Having selected j, 
let i be minimal such that uj{T>j)i < w(T>j)i+i. Since uj{Tyj)i > a;(T>j)i_|.i (by 
the maximality of j), we must have uj{Tyj)i — w(T>j)i-|_i, and column j of T must 
have an unbarred i + I but not an unbarred i. Thus 

(3) {p + uj{T>j))i^ {p + u;{T>j))i+i. 

Define T* to be the barred skew tableau of shape A obtained from T by re- 
placing T<j by Si(T<j). It is clear that T* G B\, and that T ^ T* defines an 
involution on the Bad Guys in Bx. Furthermore, by Lemma l3.6r i). (y) — CT{y). 
By Lemma ISlJii), a;((r*)<j) = s,w(r<j). By ©, p + uj{{T*)>,) = p + w(T>,) = 
Si{p+uj{T>j)). Consequently, p+uj{T*) = Si{p+uj{T)), implying that ap+uj(T*)ix) — 
-ap+ij{T)ix). Therefore ct* (y)ap+^(T-)(x) = -CT(y)ap+^(T) (x). Thus the contri- 
butions to J2 CT{y)o.p+u){T){x) of two Bad Guys paired under T ^ T* cancel, and 
the contribution of any bad guy paired with itself is 0. □ 

4. Change of Basis Coefficients 

In this section, let = [xi, . . . , Xn) and y — (yi, y2, ■ ■ ■) be two sets of vari- 
ables. Since {s^i(x(„)) | /i G Vn} and {s^(x(„) \ y) \ n G Vn} both form Z[?;]-bases 
for y]'^", we have change of basis formulas 

(4) sxix(^n) \ y)^ ^\.niy)^t^i^{n)), ^r somc c'^^ Jy) G Z[y]. 

(5) SA(a;(„)) = ^ d^_„(2/)sp(a;(„) |y), for some d^_„(y) G Z[y]. 

Since (|4]) is a special case of ([Ij, Theorem 12.21 gives a new rule for the coefficients 
c^niy) (^^® |Moll Section 4], which gives a different tableau-based rule for 

^{y)). The main purpose of this section is to give a new rule for the coefficients 
^Xniy)'- t-'^i^ ^'^1^ follows from our rule for c^„(y) and Proposition 14. iT iii) below. 

We point out that all formulas in Proposition l4. II can be deduced as special cases 
of formulas involving double Schubert polynomials appearing in Macdonald [MaTJ 
Chapter 6] and Lascoux [La2i Theorem 10.2.6]. Our approach is to instead use a 
formula by Macdonald [Ma2l for „(y), which appears as ProDOsition l4.ir i) below, 
in order to prove Proposition [47TJii) and (iii). All proofs in this section arc replicas 
or modifications of proofs appearing in Macdonald |Ma3[ Chapter 1] . 

Let r be a nonnegative integer and p a positive integer. The r-th elementary 
and complete symmetric polynomials in variables yi,...,j/p, denoted by 
er{y{p)) and hr{y(p)) respectively, are defined by the following generating functions: 

p 

E{y{p),t) = n^i + y*^) ^Y.^r{y{p)y. 

(6) 1^ 

H{yip),t) = n(i - u^t)-' = hr{yip)W- 

i=l r>0 

It follows that ea{y(p)) — ^o(y(p)) — Ij and er{y(p)) = for r > p. For r < 0, 
er{y(p)) and hr{y(p)) are defined to be 0. For A = (Ai,...,A„) G V^ let m be 
any integer greater than or equal to X'l, the number of columns of A. Define A*^ = 
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(A^,.. 

1 = 1,. 



,Af„) e "Pm, the complementary pairtition to A, by A? = n — AJ„_|_i_j, 



Figure 2. The partitions A 
(4, 4, 4, 3, 3, 2, 2, 1), where n = A, m - 



(5,3,1) and A'^ 



Proposition 4.1. ("zV <„(y) = det (eA,-p,-,;+i(2/(A.+n-,))) i<,^j-<„- 
f**^ <n(y) = det (/iA,-^,-«+j((-?y)(^.+„+i-»)))^<^^^.<„. 

Before proving this proposition, we prove the following lemma (see also |Ma3[ Chap- 
terl]). LetA^ eN,A= (e,_, (y(,)))g^^^^.<^_^, and = {h^-J {{,-v)u+i))) o<,^j<n-v 

Lemma 4.2. A and B are inverse matrices. 

Proof. Let q > p. By ([6]), E{y(^qj, t)H{{—y)(^p), t) is a polynomial of degree q— p \n. 
t. Also by (111), 



£;(y(,),t)i?((-y)(rt,t) 



E E 

J\/>0 \r+s=7\/ 



M 



Thus for q > p, 
(7) 



E 

r+s=Af 



er(y(9))/is((-y)(p)) = 0, i{M>q-p. 



For < i,k < N - 1, consider {AB).,^k J2^=o^ e^-j{y(^,))hJ^k{{-y)(k+l))■ If 
i < k, then for each j e {0, . . . , iV — 1}, either i — j < or j — fc < 0; thus 
{AB)i^k =0. If i > /fc, then {AB)i^k = hy M = i - k. If i = fc, then 
(A_B)i.A; = 1. This completes the proof. □ 



Proof of Proposition \4.1\ As noted above, (i) is proven in Macdonald [Ma2| . Define 
'Pn,m = {j^ £ Vn \ K ^ "i}. Let N = n + m, and let In^N denote the n-element 
subsets of{0,...,A^ — 1}, which we always assume are listed in increasing order. 
The map tt : Vn,ni In,N given by = ('^i)"=i ^ lu = {vi + n ~ i}i=„, is a 
bijection. 

The matrix A is lower triangular with I's along the diagonal, so det (A) = 1. For 
I, J €z In,N, let Ai^j denote the n x n submatrix of A with row set / and cohmm 
set J. By (i), c^„(y) = det(A/^j^J. This implies the following interpretation of 

Cxniv)'- letting K^A denote the (^) x (^) matrix {dei{Ai ,j))i jfzi^^ , where the 
rows and columns of A'M are ordered by some order on In,Ni C\n~ i^"^)ixJ^ 
(note that (A'M)/_j refers to a single entry of A"A, whereas Aj^j refers to an 
nxn submatrix of A). By Lemma l42l A"i? = (A"v4)"^, and thus d'^^{y) = 
(AM),-i = (A"S),„,^ = det(S,„,J. This proves (ii). 
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To prove (iii), we give a different expression for (A" A) ^. For / G In,N, define 
PI = #{j < i \ i e I,j e /'} and /' = {0, . . . , AT - 1} \ / e Im^N- Tlie'following 
formula gives the Laplace expansion for determinants (see, for example, [Bol III, 
§8, no. 6]): for / e In,N, K G lN-n,N, 



(_l)P(/)+P(./) dctiAij) detiAK,j') 



fdet(A) HK^r 

jo liK^r 



Thus, since det(j4) ~ 1, A"yl is invertible, and 

(A'M)-i = f (_i)pW+p(J) dei{Aj. I,)] 

Consequently, 

(8) d^,„(y) ^ {A"A)J^\ = det(A,, ). 

For ly e T'n,m, consider the following two elementary properties of I^. 

1. = \iy\~n 2. Il = /,c 

To prove property 1, note that for = {zi,...,i„}, ii < ■■■ < i„, we have 

piU) = («i - 1) H \- {in -n) and = (n - 0) H h {in - {n - !))• To prove 

property 2, partition the rectangular Young diagram D with n rows and m columns 
as D = i/U i^'^ (see Figure [2|). Number the boundary segments, which are darkened 
in Figure [21 from to to + n — 1. The numbers on the vertical and horizontal 
segments are the elements of and /^c respectively. This completes the proof of 
the property 2 (see also [Ma3|. (1-7)]). 
Applying these two properties to 

dUv) = (-l)l'l+l^ldet(A,^..,z,.) = {-ir^+^^^c^.,„Ay)- 

Proposition I4.ir iii) now follows from the fact that c^c m(y) is a homogeneous 
polynomial of degree \p'^\ — \X'^\ = {nm — \p\) — {nm — |A|) = |A| — \p\; thus 

(-i)i^i+i'^ic;i:,,„(y) = (-i)iAHpic;;;,„(y) = c^;,,,{-y). □ 

Remark 4.3. Theorem \2.2\ combined with Proposition \^. 1\ leads to a solution to the 
problem discussed in the introduction of expanding s\{x \ y) in the basis of factorial 
Schur functions: sx{x\y) = X^/^e-p ^x{y)^tJ.{^\y^^^)' where 

<{y)= E ^x(y)<n{/'^)- 

Additionally, one can express c^(y) in terms of change of basis coefficients and 
classical Littlewood- Richardson coefficients. For example, for r = 2, 

where c^ ^ Eli is the classical Littlewood- Richardson coefficient. 
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